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ABSTRACT 

The Minneapolis Public School system was awarded an 
Elementary Secondary Education Act (ESEA) Title I grant. The purpose 
of these funds was the further development of insights, awareness^ 
competence^ and skill toward making living and learning effective for 
eligible students. Two programs are described: (1) inservice teacher 
training for the East^ Norths and West Areas; ar.d (2) a Mathematics 
Criterion Referenced Testing Program. Evaluation of the inservice 
program focused on two major concerns: (1) the process of 
implementing the inservice programs^ and (2) the perceived need for 
the future inservices. Tables provide summaries of participant 
responses to Title I services and provide a comparison between staff 
with less than one year or no experience with Title I children and 
the total group^ as reflected by the mean rating of desire for more 
inservice factor. The Mathematics Criterion Referenced Testing 
Program was developed to: (1) produce a computational math skills 
testing program^ ^2) identify Title I children in mathematics^ (3) 
evaluate the progress of Title I children^ and (^) evaluate 
alternative math programs. The report presented here focuses on the 
development of operational guidelines. (Author/BJG) 
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A Process Evaluation of 
Title I Summer In-Service and 
Mathematics Criterion Referenced 
Testing Program 

Summary 

See Page 

In July, 197^1 the Minneapolis Public School System was awarded 
a Sll9,01O addendum to its Title I ESEA grant to develop insights, 
awareness, competance and skill in working with Title I children. 
The money allocated in this addendiim was divided among three project 
components: (l) Inservice for the East, North and West Areas, (2) a' 
Mathematics Criterion Referenced Testing Program, and (3) a Parochial 1 
Reading Workshop for Materials Production for primary level teachers 
and aides. This report presents a process evaluation of the Summer 
Inservice Program and the Mathematics Criterion Referenced Testing 
Program. Because of its similarity to the Parochial Reading Work- 
shop for developing materials for intermediate students the parochial 
component was not included in this evaluation. 

Funds in the amount of Sl01,095 were allocated for 30 hours of 
inservice training for Title I teachers and aides in the East, North, 
and West Areas. Evaluation of that inservice program focused on two 
major concerns: (a) the process of implementing the inservice pro- 
grsims, and (b) the perceived need for future inservices. Process 
observations of the inservice programs 'indicated that the project was 
implemented according to plan. Delay in providing evaluation feedback, 2 
failure to begin sessions on time, and overcrowding of some meeting 
rooms were the major problems identified. In response to the future 
need for inservice training, results of the opinionnaire administered 
to project participants revealed a strong relationship between desire 
for more information in a content area and level of satisfaction with 
what was presented in that area. Suggestions for future inservice train- 3^ 
ing generally reflected the theme .of the inservice for that area. 

The Mathematics Criterion Referenced Testing Program was developed 
to (a) produce a computational math skills testing program for Title I 
children in grades K-6,' (b> to identify Title -I children in mathematics, 
(c) to evaluate the progress of Title I children and (d) to evaluate 
alternative math programs. • Funds in the amount of Sll,132 were allocated 
to support the project. Because three of the four goals had not been 3^ 
implemented at the writing of this report evaluation presented here 
focuses on the development of operational guidelines. One important 
outcome of the evaluation is the identification of issues yet unresolved 
among project decisionmakers. 

* * * 
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A Process Evaluation of 
Title I Summer In-Services and 
Mathematics Criterion Referenced 
Testing Program" 

In July, 197^, the Minneapolis Public School System was awarded a 
$119,010 addendum to the 1973-7^ ^SEA Title I grant • According to the 
grant application, the purpose of those additional funds was "the further 
development of insights, awareness, competence, and skill toward making 
living and learning effective for students who are eligible for Title I 
services." The need for this goal was derived from concerns expressed 
by: (a) the Office of Instruction about the Desegregation/Integration 
program in elementary schools and from (b) the Office of Planning, Develop- 
ment, and Federal Programs about placement and service to Title I students. 

There were three components to the plan for achieving this goal. By 
far the largest allotment of funds, $101,095, provided for inservice train- 
ing for professional personnel and aides assigned to work with Title I 
children during the 197^-75 school year. Each Area was asked to develop 
a plan to provide thirty hours of inservice training for teachers and aides 
in that Area. In addition, $11,132 were allocated to develop a Mathematics 
Criterion-Reference Testing program. Finally, 86,783» were provided to 
parochial schools for a workshop on producing materials for primary Title I 
students. 

The purpose of this report is to present the results of a process 
evaluation of the Summer Title I Inservice program and of the Mathematics 
Criterion-Reference Testing program. The Parochial Reading Workshop for 
Materials Production was omitted from the evaluation because an identical 
project with intermediate personnel had been evaluated from January to 
June, 197^. 

For each component evaluated, this report will present: 

a. a statement of the focus of the evaluation, * 

b. a description of the project including detailed operational 
guidelines, 

c. a summary of findings, 

d. recommendations for future Title I projects. 
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TITLE I SUMMEK INSERVICE 
EAST, WEST, ANB "NORTH AREAS 



Focus of the Evaluation 

This evaluation of the Title I Summer Inservice for the East, West, 
and North Areas focuses on two major concerns: (a) the process of imple- 
menting the inservices and (b) the perceived need for future inservices. 

The process focus of this evaluation involved first, establishing 
operational guidelines for each component of the project. Operational 
guidelines are detailed project plans which delineate specific activities 
to be completed, anticipated completion dates, and persons responsible. 
Once developed, operational guidelines serve as the basis for observing 
project operations to determine whether or not the project is actually 
implemented according to plan and to identify successes and problems with 
that implement at ion • 

In addition to this process evaluation, project decision makers re- 
quested information about perceived needs for future Title I inservice 
training. In response to this request, three opinionnaires were developed, 
one for participants in each of the three areas (See Appendix A). Partici- 
pants were asked to rate each session they attended according to: 

1. Need for knowledge in the content area prior to the in-service 

2. Level of satisfaction with what was learned 
3« Desire for more inservice in that area 

In open ended items participants were also given -an opportunity to 
make additional comments about the inservices and to suggest other topics 
for future Title I inservices. 

This report will present first the process evaluation. It will include 
a general description of the proci'^am, operational guidelines for each com- 
ponent and a summary of process observations. These results of the opinion- 
naire will be presented for the East Area, the North Area, and the West 
Area. Based on. 'information presented there, recommendations for future Title 
I inservices ^will be made. 
Project Description 

The purpose of the Title I Summer Inservice Program was **the development 
of insights, awareness, competance, and skill toward making living and learn- 
ing effective for students who are eligible for Title I services.** Specific 
goals and objectives for teachers and aides were to be developed by each 
Area. Funds were allotted for approximately thirty hours of training in 

?- 
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each area. The total inservice program was coordinated by a teacher on 
special assignment. Specific activities assumed by the project coordinator 
in the management of the inservices and program plans for each Area are 
outlined in the operational guidelines that follow. 



Title I - Part C In-Service 
North ,^est and East Areas 
Summer, 197^ 

OPERATIONAL GUIDELINES 





Component: Management Page \ 


Number 


Activity 


Completion 

Date or 
PreQuencv 


A ^iio 1 
AC UUttX 

Completion 

Date or 
Freouencv 


Person 
ResDonslble 




RESOURCE Allocation 










Personnel 










Selection 










Select project coordinator 




Vl6/7^ 


Harry Vakos 




Payment 










Submit service reports for payment 
of teachers on special assignment 


Every 2 
weeks 


Every 2 
weeks 


Paul Larson 




Submit general requisition forms for 
''the "oavmpnt of tearherf; and anripR 
participating in inservice 


North Area- 

West Area- 
8/29/7^ 
East Area- 

7/1 Q and 

8/30/7^ 


North Area 
8/23/7^ 
West Area- 
8/29/7^ 
East Area- 
7/19 and 
8/30/7^ 


Paul Larson 




Budget 










Maintain project budget 


Weekly 


Weekly 


Paul Larson 




PROJECT PLANl^JING 










Tdentifv Wpv HpfiRinn mak^pr* tippHr aiiH 
expectations for the workshop 










J: t LltJX d-L piUJGCUo 

Office for Instruction 
Area superintendents 
Area principals 
Area teachers 










Develop workshop goals 






Herb Karsten 




Identify planning committees in each 
area 




5/1/7^+ 


Paul Larson 




Develop objectives for each session 


6/17/74- 


6/17/74 


Paul Larson* 




Select and/or develop activities to 
meet identified goals and objectives 


6/17/7^+ 


6/17/7^+ 


See Staff 

Development 

Component 




Identify necessary resources: Persons 
and materials 


7/1/7^ 


7/1/7^+ 


Paul Larson 




Schedule program time and places 


7/1/7^ 


7/1/7^+ 


Paul Larson 



*While Paul Larson was responsible for seeing that programs were developed within each area, 
other persons were responsible for deciding what those programs should include. Key persons 
in each area are: East Area: Elmer Koch, Irene Larson, Jean Hudson, Barb Bellair, and 



Title I principals. West Area: Mildre'd Carlson, Jean Hudson, Eloise Nelson, Lowery Johnson, 
Cynthia Tyson, and one teacher from each building. North Area: Mabel Melby, Louise Gorgas, 
»"hv fiiney and Title I principals. ^1*1 
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OPERATIONAL GUIDELnffiS 
Component; Management (continued ) Page 2 



Operation 
Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



ERLC 



Write operational guidelines which 
specify project activities, persons 
responsible, and completion dates for 
each project component. 

Secure consensus about operational guide 
lines with decision makers 

PRaJECT IMPLEMENTATION 

Physical facilities 



6/21/7^ 



6/21/7^ 



6/30/7^ 



Sandy Schilling 



Sandy Schilling 
Paul Larson 



Make arrangements for physical facilities 
for each session 

Buildings 
# Rooms 

Seating arrangement 

Equipment 

Agendas 

Coffee 

Prog'>"am participants 



Contact each program participant to make 
sure that he (a) understands his responsi- 
bilities and (b) intends to fulfill them 

Process Evaluation 



Observe project to identify discrepancies 
between actual implementation and project 
plan. Provide feedback to Larson and Moon, 

Provide feedback, to decision maker 
questions about the project 

Identify decision makers information 
needs 

Develop data collection instruments 



Collect data 



Tabulate data 



Within 2k 
hours before 
each session 



Within 2k 
hours be 
each> sessio 



for e Paul 



North Area- 
Larson 
oJciEast Area- 
Elmer Koch 
West Area- 
Paul Larson 



Within 72 
hours before 
each session 



Between 
7/l/7k and 
8/31/7^ 



Between 
S/2k/7k and 
7/8/7^ 

Between 
7/1/7^+ and 
8/13/7^+ 

Between 
7/8/7^ and 
8/28/7^ 

As available 



Within 72 
hours befoije 
each session 



Paul Larson 



12 



Between 
7/1/7^+ and 
8/31/7^+ 



Between 
S/2k/7k and 
7/8/7^+ 

Between 
7/l/7k and 
8/15/7^ 

Between 
7/8/7^ and 
8/28/7^ 

East area 
8/10/7k 
North and 
West 



Sandy Schilling 



Sandy Schilling 
Sandy Schilling 
Sandy Schilling 
Sandy Schilling 
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Component: Management (continue d) Page 3 



Operation 

Number 


Activity 


Anticipated 
Completion 

JDate or 
Frequency 


Actual 
Completion 

Date or 
Frequency 


Person 
Besponsible 




Feedback results to decision makers 
requesting information 


Within 5 
days alter 
data is 
available 


East area: 
Within p 
days after 
data was 
available, 
JNortn ana 
West area: 
Within 2 
months afte 
Qata was 
available. 


Sandy Schilling 




Use evaluation feedback to modify project 

plajis* v?i.. vir 


As needed 




Paul Larson 




COMMUNICATION^ 










Orientation 










Inform persons who provide Title I 
services of the purpose of this project 




k/22/7k 


Herb Karsten 




Inform project coordinator of project 
purpose and his responsibilities in 
managing the project 




k/l6/7k 


Larry Moon 




Infonn planning team of project purpose 
and their role in planning to meet 
those needs 




East Area- 
k/l8/7k 
North Area- 

k/22/7k 
West Area- 

k/2k/7k 


Paul Larson 




Inform participants of meeting schedule 
and objectives 




North Area- 

5/31/7^ 
West Area- 

5/31/7^ 
East Area- 
W7k 


Paul Larson 




Reporting 










PT'P'naT'p RDPfi "Tn evaluation fpedbflfk 
reports for decision makers who request 
information ,^ - 


Within S 
days after 
data is 
available 


11/1/7^ 


fcjciriiij ocnixxmg 




Prepare evaluation report for federal 
projects office 


9/30/7^ 


10/31/7^ 


Sandy Schilling 


a 


Report progress to Parent Advisory . 
Committee 




Vl7/7^ 

5- 15-7^ 

6- 19-7^ 


Paul Larson 
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OPERATIONAL GUIDELINES 



Component : 



East Area 

Staff Development 



Page k 



Operation 

Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



ERLC 



Conduct two three-hour area meetings for 
Title I teachers and aides to present 
information about: 

a. Title I services 

b. Explanation of Title I, use of 
materials 

c. IMC 

d. Aides 

e. Objectives and evaluation 

f. Needs assessment 

Conduct two three-hour area meetings for 
Title I teachers and aides to present 
information about: 

a. Definition of an individualized 
approach as a child-centered learn- 
ing atmosphere 

b. Organization of the learning environ- 
ment 

1, Scheduling 

2, Record -keeping, diagnosis 

3, Grouping 
Interest centers 

5. Room arrangement 

c. The teacher as resource 

1, Inter-relatedness of curricu- 
lum areas 

2, Conferencing with students 

3. Providing motivating learning 
experiences 

4. Effective use of discussion 

5» Planning instructional and in- 
dependent activities 

Conduct one two-hour area meeting for 
Title I teachers to present information 
about : 

a. Moffett Interaction Program 

1. Description of program 

2. Review of materials 

3. Use of materials 



7/8/7^ and 
7/11/7^ 



7/9/7^ and 
7/10/7^ 



7/12/7^ 



7/8 and 
7/11/7^ 



7/9/7^ and 
7/10/7^ 



7/12/7^ 



Paul Larson 

Larry Moon 
Larry Moon 

Mitch Trockman 
Don Turkington 
Dick Faunce 
Jean Hudson 
Barbara Bellair 



Peg O'Shaughnessy 
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OPERATIOHAL GUIDELIIIES 



Component : 



East Area 

Staff Develo-pment 



Page ^ 



Operation 

Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responalble 



b. Language Experience Approach 

1. Philosophy 

2. Methodology 

a. Vocabulary-controlled 

b. Non-controlled vocabulary 
3« Implementation 

Conduct one two-hour area meeting for 
Title I summary teachers to present infor- 
mation about: 

a. Testing 

1. Mastery tests 

2. Informal inventories 

3. Learning rate tests 
^. Slammer school records 
5« Teacher judgment 

b. Interest Survey 

1. Interest inventories 

2. Conferencing with students 

Conduct one two-hour area meeting for 
Title I intermediate teachers to present 
information about: 

a. Testing 

1. Mastery tests 

2. Informal inventories 
3« Learning rate tests 
k. Summer school records 
5. Teacher judgment 

b. In"6fefest Survey 

1. Interest inventories 

2. Conferencing with students 

Conduct one three-hour area meeting for 
Title I teachers to present information 
about the following commercial materials: 

1. SR/V 

2. Reader's Digest Skill Builders 
3« Wesley Reading Development Kits 
km Comprehension materials 

purchased during spring, 197^ 



7/15/7^ 



7/15/7^ 



Peg O'Shaughnessy 



7/16/74 



Peg O'Shaughnessy 
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East Area 
Component ; Staff Development 



Page 6 



Operation 

Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



ERIC 



Conduct one three-hour area meeting for 
Title I teachers to present information 
about Comprehension techniques 

1. Research review 

2. Questioning strategies 

3. Using ^^close" procedures 

Conduct one three-hour area meeting for 
teachers and aides to present information 
about : 

1. Math Objectives 

2. Assessing math achievement 

3. Evaluation 

Conduct two forty-five minute area meetinge 
for teachers and aides to present infor- 
mation about commercial math programs 

a. Games 

b. Activity cards 

c. Filrastrips and tapes 

d. Drill materials 

Conduct one forty-five minute area meeting 
for teachers and aides to present infor- 
mation about cl-assroom organizations: 

a. Contemporary 

b. Open 

c. Continuous Progress 

d. Early childhood 

Conduct one two-hour area meeting for 
teachers and aides to present information 
about : 

a, IMC Materials 

1, Re-organization of available 
materials for an individualized 
program, 

2. Development of materials to 
reinforce basic reading skills 
in an independent gituation 

b. North Area Materials developed 
through Part C funds in the spring 
of 197^ 

and one three-hour area meeting for staff 
interaction within buildings 



7/17/7^ 



7/17/7^ 



7/18/7^ 



7/l8/7^ 



Barb Bellair 



Barb Bellair 



Elmer Koch 



1 G 



OPERATIONAL GUIDELINES 



West Area 
Component ; Staff Df^velnpmPnf. 



Page _2_ 



Operation 

Number 



ERIC 



Activity 



Conduct one six hour area meeting 
for teachers and aides to present 
information about: 

a. Title I services 

b. Explanation of Title I, use of 
materials 

c. IMC 

d. Aides 

e. Objectives and evaluation 

f. Needs assessment 

Conduct one three and one-half 'hour area 
meeting for teachers and aides to present 
information about: 

a. Comparative analysis- family styles 

b. Value elicitation 

Conduct one two and one-half hour meeting 
for teachers and aides to present informa- 
tion about: 

a. Survival strategies 

1, Behavior 

2. Language 
3« Psychology 

b. Assessment procedures and their 
implications for schooling 

Conduct one six hour area meeting 
for teachers and aides to: 

a. Have community-teacher dialogue 

b. Present information about concept 
of self concept 

c. Present information about behavioral 
objectives and self concept 



17 



10 



Anticipated 
Completion 

Date or 
Frequency 



8/21/7^ 



8/22/7^ 



8/22/7^ 



8/23/7^ 



Actual 
Completion 

Date or 
Frequency 



8/21/7^ 



8/22/7^ 



8/22/7^ 



8/23/7^ 



Person 
Responsible 



Larry Moon 
Larry Moon 

4itch Trockman 
Don Turkington 
3ick Faunce 
Jean Hudson 



^nita Tucker 
M Sullivan 



Al Sullivan 



John Taborn 



Al Sullivan 
M Sullivan 

Al Sullivan 
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West Area 

Staff Development 



Page 8 



Operation 

Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



Conduct one three and one-half hour area 
meeting for teachers and aides to: 

a. Observe Title I materials display 

b. Present information about a strategy 
for talking to and with children 

c. Present information about affective 
behavioral objectives 

Conduct individual building meetings (nine 
hours) 



8/26/7^ 



8/26/7^ 



8/26/7^- 
af ternoon 

8/27/7^- 
all day 



8/26/7^- 
afternoon 
8/27/7^- 
all day 



Irene Larson 
Bob McCawley 

Bob McCawley 

Building 
principals 
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North Area 
Component : Staff Developngnt 



OPERATIOIWL GUIDELINES 

Page 9 



Operation 

Number 



Activity 



ERLC 



Conduct one six hour area meeting for 
teachers and aides to present information 
about : 

a. Title I services 

b. Explanation of Title I, use of 
materials 

c. IMC 

d. Aides 

e. Objectives and evaluation 

f. Needs assessment 

Aides and teachers, grouped by building 
clusters^ will participate in five mini 
courses : 

a. Orientation of the Title I child 

b. Assessing reading and math 

c. One of the following two choices: 

1. Perceptual motor development 
2* Teachers aides 

d. One of the following two choices: 

1* Self awareness-self concept- 
process approach 

2. Learning materials 

Provide twelve hours for individual 
building meetings 



J -la 



Anticipated 
Completion 

Date or 
Frequency 



8/19/71^ 



8/20 and 
8/21/7^ 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



8/19/7^ 



8/20 and 
8/21/7^ 



Hay cluster- 


' Hay 


7/27 


7/27 


7/28/7^ 


7/28/7^ 


Lowe 11- 


Lowe 11- 


Hawthorne- 


Hawthorne- 


7/22 


7/22 


7/23/7^ 


7/23/7^ 


Cleveland 


Cleveland- 


cluster 


8/22 and 


8/22 and 


8/23/7^ 


8/23/7^ 


Putnam 


Putnam 


8/27/7^ 


8/27/7^ 


Bethune 


Bethune 


8/22 and 


cluster 


8/23/7^+ 


8/22 and 




8/23/7^ 





Larry Moon 
Larry Moon 

Mitch Trockman 
Don Turkington 
Dick Faunce 
Ruby Riney 



Sharon Buckner 
Louise Gorgas 



Carolyn Papke 
Don Turkington 



Mabel Melby 

Christine Carr 

Building 
principals 



Summary of Process Observations 

Observations of 'the Summer Title I In-service Program indicate that 
for the most part, the project was implemented according to plan. Persons 
responsible for organizing and developing the various program components 
carried out the assigned activities on schedule. Likewise, persons respon- 
sible for arranging facilities and presenting inservice programs performed 
according to plan. In fact, the only discrepancy with the operational guide- 
lines seemed to be in the schedule of providing evaluation feedback to project 
decision makers. 

Two factors are primarily responsible for this delay in providing, evaluation 
feedback. Data from the North and West Areas could not be collected until the 
last week of the project evaluator's contract. Also, the request to make this 
report a formal one required more than the 80 hours the evaluator had negotiated 
for providing 'feedback. Even after this manuscript is submitted additional delay 
will be required for the typing, editing and approving process. 

Besides the discrepancy with the project plan for reporting evaluation 
results, two problems were observed which should be noted here. Failure to 
begin on time was a problem observed throughout many of the inservice sessions. 
Participants wandering into sessions up to an hour late both morning and noon 
and coffee breaks that sometimes extended for twenty to thirty minutes were 
common occurrances in the East Area, but particularly in -the North Area in- 
service sessions. The problem was less apparent in the West Area where the 
meeting space was more confined and where break's were less frequent. 

A second problem, unavoidable perhaps, but a problem nonetheless, is the 
situation that arises when meeting participants are given free. choice of 
what sessions to attend. There were instances in both, the East and^ North 
Areas where some sessions were standing room only and others we^^e. attended 
only meagerly. 

Before concluding this summary of process observations, it seems ap- 
propriate to consider one final point regarding the development of operational 
guidelines for inservice sessions. • While the guidelines that were developed 
for the management component may have been helpful in assuring that all bases 
were covered and that everyone knew the players, there may be some question 
about the usefulness of the guidelines that were developed for each Area 
inservice. Information for those three components was simply copied , from 
the meeting programs. 

What seems important is that detailed plans are formulated for each 
inservice, not the form they take. Further, it seems that little can be 

o 20 15 ^ ' 
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learned by simply checking off, "yes or no," whether or not each agenda 
item is covered. Unless qualitative or quantitative criteria are built 
into the operational guidelines for inservice sessions, their usefulness 
is surely open to serious criticism. 
Opinionnaire Results : 

The purpose of this section is to present some ansv/ers to the question, 
"what are the needs for future Title I inservice training?" The source of 
data for consideration is participant responses to opinionnaire administered 
at the conclusion of the East, the North, and the West Area Title I summer 
inservices. Responses will be summarized for each content area or topic 
covered according to three factors: (l) need for knowledge prior to the 
inservice, (2) level of satisfaction with what was learned, and (3) desire 
for more inservice in that content area. The mean response (scale 1-very 
low to 5-very high) as well as the frequency of response at the various 
points on the scale will be given for each factor within each topic. Signif- 
icant comparisons will be noted both among factors within a topic and among 
topics. In addition, comparisons in responses to the desire for more infor- 
mation factor will be made between participants with less than one year or 
no experience with Title I children and the Total group. Finally, other 
suggestions for future Title I inservice training will be summarized. 

East Area . Responses to the opinionnaire of the East Area Title I 
inservice were obtained from 102 teachers, ^6 aides, I6 parents, and 3 
administrators or supervisors, a total of I67 persons. This rate of 
response is consistent with the average daily attendance at the East area 
inservice sessions. 

Data describing total group response to the opinionnaire are presented 
in Table 1. Results there indicate that mean ratings in the need for 
knowledge factor vary from 2.'+ for two topics (Services of the Federal 
Projects Office and Explanation of Title l) to 3.6 for Interest surveys and 
Diagnostic Tools for Intermediate Students. Mean ratings in level of satis- 
faction vary from 2.0 for Dr. DeVault^s presentation on Strategies and 
Systems for Individualizing Reading Instruction to 3«9 "the presentation 

on Films and Tapes for mathematics instruction. Similarly mean ratings 
in desire for more inservice vary from 1.9 f'o^ services of the Federal 
Projects Office and Explanation of Title I to 3^6 for the mathematics 
presentation of Gaines (See and Play). 
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Table 1 

Summary of Participant Responses 
to the East Area Title I Inservice 

July 8 to July 18, 197'* 

Participants: 102 teachers 
^6 aides 
l6 parents 
3 other 
Total Participants: 15? 



Need for Knowledge 



Content Area 


Mean 
Rating 


Frequency 


Mean 
Rating 


Frequency 


Mean 
Rating 


Frequency 


1 


2 


3 


k 


5 


1 


2 


3 




5 


1 


2 


3 




5 


Services of Federal^ 
Projects Office 7/8 


2 J* 


51 


23 


U\ 


19 


11 


2.6 


26 


33 


71 


11 


6 




68 


28 


36 


6 


^4 


Explanation of Title I 7/6* 




'+3 


30 


^1 


l8 


8 


2.8 


2k 


26 


69 


T 

ly 


"i 

11 


1.9 


73 


27 


35 




5 


1 Current Title 1 projects 
7/8* 


2.6 


31 


32 


^3 


27 


8 


2-9 


16 


29 


69 


19 


12 


2.1 


63 


20 




13 


5 


Use of Title I materials 
7/8* 


2.7 


32 


30 


kl 


29 


11 


2.9 


19 


19 


70 


28 


9 




50 


18 


'il 


19 


10 


Instructional Materials 
Center (IMC) 7/8 


2.7 


3^ 


27 


kk 


26 


13 


3.0 


20 


18 


63 


28 


15 


2-5 




2h 


3^* 


20 


16 " 


Tlie aides' program 7/8 


2.5 


39 


27 


ko 


23 


9 


2.9 


17 


26 


57 


28 


11 


2.2 


Gk 


2U 


2;^ 


15 


11 


Title I objectivjs and 
evaluation 7/11 * 


2.6 


36 


27 


55 


Ih 


12 


2.8 


20 


25 


71 


20 


10 


2.2 


53 


31 


39 


10 


1 

8 


Title T needs assessment 
7/11 * • 


2.6 


36 






26 


7 


2.8 


19 


25 


75 


' 16 


8 


2.2 


6l 


21 




11 


7 

! 


Hr. M. V^re DcVnult'n pre- 
/iontotion on Strategies; 
and Syctemn for Individ- 
ualizing l^eading Instruc- 
lion 7/9 


3.3 


?h 


15 


3** 


3^? 


33 


2.0 


60 


h? 


33 


9 


1 


.^7 


^0 


17 








l^ngDage experience techni- 
ques for primary children 
7/1? 


3.1 


9 


8 


22 


15 


8 




6 


8 


19 


15 


15 


3.2 


5 


10 




15 


) 

8 


l.angua^e experience techni- 
que's for intermediate 
children 7/12 


3.2 


3 


k 


15 


6 


7 


3.3 


1 




16 


10 


^4 


3.2 


5 


5 


10 


9 


6 


Moffett interaction program 
for primary children 7/12 








8 


5 


13 


3.5 


0 


7 


13 


9 


8 


3.1 




6 


13 


6 


6 


MofTytt int/^rar: t ion for 
1 fj» ♦^rmedin chi hdr^'n l/V^ 


3.'^ 


? 




9 


7 


- 6 


2.8 




5 


1^ 


h 


1 






^4 


9 


7 


6 


In^'Tont nurvt>yfj and diag- 
{!0/;l:ic tooln for primary 
raudf'nt n 7/1 "7 


5. 'I 


'4 


6 


30 


15 


13 


5.3 


? 


13 




17 








16 




r, 


7 


Jntf^rest surveys and diap;- 
notjtic tools for inter- 
m-^diate students 7/13 


3.6 


2 


1 


16 


11 


8 


3.3 


2 


3 


17 


13 


3 


2.9 


5 


12 


9 


5 


7 


Commercial reading 
materials 7/l6 


3.0 


6 


10 


28 


12 


6 


3.0 


6 


11 


25 


1^ 


6 


2.7 


11 


1^4 


21 


10 


^4 


Reading comprehension 
fpchnlques 7/l6 


3.5 


3 


k 


28 


18 




3.^ 


^4 


7 


27 


17 


11 


3.3 


3 


8 


28 


20 


6 



Level of Satisfaction 



Desire for more in-service 



Note: In some cases sessions were presented simultaneously =..so that participants 
had a choice of sessions they attended. 
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Aides were invited to participate in-.these sessions. 

2? 



Table 1 



(Continued) 

Summary of Participant Responses 
to the East Area Title I Inservice 



Content Area 


Need for Knowledge 


Level of Satisfaction 


Desire for more in-service 


Mean 
Rating 


Free 


luency 


Mean 
Hating 


Frequency 


Mean 
Rating 


Frequency 


1 


2 


3 




5 


1 


2 


3 


if 


5 


1 


2 


3 




5- 


Dr. M. Vere DeVault's 
prestntation on Strategies 
for Individualizing Math 
Instruction 7/10 * 




20 


12 


36 


37 


3** 


2.3 






32 


18 


3 


3.0 


25 


20 


M 


27 


19 


CGAM and CAT as tools for 
individualizing 7/10 


3.2 




±± 


T Q 






2.9 




Q 






n 
( 


3.1 


J- J 


fl 

0 






It: 


Using diagnosis kits to 
aaaict in individualizing 
the Houghton Mifflin Math 
program 7/10 * 




7 


10 


31 


22 


22 


3.2 


7 


13 


38 


29 


8 


3.0 


13 


16 


33 


20 


10 


An example of how an in- 
dividualized nia|th program 
functions 7/10 




8 


7 


32 


21 


18 


3.0 


9 


15 


35 


23 


6 


3.2 


8 


13 


31 


23 


13 


An example of an aesess- 
ment tool to use in the 
individualizing process 
7/10* 


3.2 


7 


6 


30 


16 


10 


3.0 


6 


11 


36 


11 


7 


2.8 


11 


1^+ 


29 


13 




How to write behavioral 
objectives 7/17*. 


3.1 


23 


17 


'+2 


31 


23 


3.2 


12 


19 




35 


16 


2.6 


33 


31 


3^+ 


?h 


11 


Critiquing objectives 
from various sources 7/17 


2.9 


17 


11 


32 


19 


10 


3.0 


11 


17 


38 


17 


9 


2.6 


25 


12 


31 


\U 


7 


Comet; (Say and Play) 7/l8 * 




11 


12 


^+3 


35 


21 


3.6 


6 


9 


38 




26 


3.6 


13 


8 


28 


39 


3^ 


Activi ty jpards (See and 
Do) 7/l8 


3.5 


8 


7 


31 


27 


21 


3.7 


2 


8 


31 


31 


22 


3.^ 


8 


11 


31 


25 


21 


Films and tapes (See and 
Hear) 7/l8 * 


3.5 


5 


5 


26 


23 


16 


3.9 


2 


2 


20 


3'* 


19 


3.3 


9 


11 


22 


15 


18 


Drill materials (Write 
and Practice) 7/l8 * 


3.1 


6 


6 


8 


9 


7 


2.7 


6 


12 


7 


7 


3 


3.2 


8 


6 


7 


3 


13 



23 

16 



Attempting now to summarize the data presented there, several patterns 



seem to emerge : 

1. Sessions presented by the Federal Projects office received c r u stent ly 
lower ratings in need for knowledge prior to the inservice, in level of 
satisfaction with what was learned, and in desire for more inservice in 
that content area than other sessions. From 40 to 50 per cent of the 
participants expressed very little to little need for inservice in that 
content area prior to the inservice. 

2. The sessions on materials for teaching mathematics (Games, Activity 
Cards, Films and Tapes, and Drill Materials) received generally higher 
ratings across the three functions than other sessions, 

3. In general, the mean level of response to the factors within a content 
area were fairly consistent across the three factors. A high level of 
satisfaction was nearly always accompanied by high need for knowledge 
and high desire for more information. One exception to this trend was 
Dr. DeVaults presentations on Individualizing Reading Instruction and 
Individualizing Math Instruction. In both cases the need for knowledge 
factor was rated between average and high while the level of satisfaction 
was low for reading and between low and average for math. Desire for more 
information in that content was about average in both cases. 

k. While the mean ratings do not reflect a strong desire for additional 
training in any of the content areas included in this inservice, some 
persons did express high to very high desire for more information. 
Areas where most persons expressed such a desire are the IMC (36 persons), 
individualizing reading instruction (^3 persons), individualizing math 
instruction (k6 persons), writing Behavior Objectives (35 persons). Games 
for teaching math (72 persons), and activity cards for teaching math 
(46 persons). 

Table 2 presents a comparison of responses to the desire for more inservice 
factor between participants with less than one year or no experience with 
Title I children and the total group. What is rost significant about this 
data is the difference in responses to content presented by the Federal Projects 
Office. Persons with little or no experience in Title I expressed considerably 
higher desire for more inservice in those content areas than the total group 
of participants. That trend did not hold for other content areas presented 
during the inservice. 
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Table 2 



Comparison of mean ratings of the desire for more inservice factor between 
East Area participants with less than one year or no experience with Title I 
children and the mean ratings of the total group. 



Content Area 


Desire for more inservice 


^ .. ■ 

Partrdipants with 
less -than one year 
or no experience 
with Title I 
children 

N=38 


Total group 
N=l67 


Services of Federal Projects Office 
7/8 


2.6 


1.9 


Explanation of Title I 7/8 




1.9 


Current Title! projects 7/8 


2.8 




Use of Title I materials 7/8 


3.3 




Instructional Materials Center (IMC) 
7/8 




2.5 


The aides' program 7/8 


2.9 


2.2 


Title I objectives and evaluation 
7/11 


2.8 


2.2 


Title I needs assessment 7/11 


2.5 


2.2 


Dr. M. Vere DeVault*s presentation 
on Strategies and Systems for In- 
dividualizing Reading Instruction 
7/9 


2.9 


2.7 


Lfmguage experience techniques 
for primary children 7/1^ 


2.7 


3.2 


Letnguage experience techniques 
for intermediate children 7/12 


3.7 


3.2 


Moffett interaction program for 
primary children 7/12 


2.7 


3.1 


Moffett interaction for intermediate 
children 7/12 




3A 


Interest surveys and diagnostic 
tools for primary students 7/15 


2.9 


2.8 


Interest surveys and diagnostic 
tools for intennediate students 7/.\5 ' 


3.2 


2.9 
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Table 2 
(Continued) 





Desire for more inservice 


Content Area. 


Participants with 
less than one year 
or no experience 
with Title I 
children 

N=3o 


Total group 

N-lby 


Commercial rea'ding materials 7/l6 


2.5 


2.7 


Reading comprehension techniques 7/l6 


3.6 


3.3 


Dr. Vere DeVault * s presentation 
on Strategies for Individualizing 
Math Instruction 7/10 


3.0 


3.0 


CGAM and CAI as tools for individual- 
izing the Houghton Mifflin Math 
program 7/10 


3.5 


3.1 


Using diagnosis kits to assist in 
individualizing the Houghton Mifflin 
Math program 7/10 


3.0 


3.0 


An example of how an individualized 
math program functions 7/10 


3.3 


5.2 


An example of an assessment tool 

to use in the individualizing process 

7/10 


2.9 


2.8 


How to write behavdora] objectives 
7/17 


2.2 




Critiquinp; obiectives from various 
sources 7/17 


2.6 


2.6 


uamcK way ana i t-cij y r/-Lu 


k.O 


3.6 


Activity cards (See and Do) 7/l8 


3-5 




Films and tapes (See and Hear) 7/l8 


3.^ 


3.3 


Drill materials (Write and Practice) 
7/18 


3.5 


3.2 
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Listed in Figure 1 are other suggestions for future Title I inservice 
training in the East Area. While no single need is apparent in the data there, 
most suggestions tend to be related to classroom instruction and materials. 
It is interesting to . note, too, that three aides from Seward suggested training 
in reading. Aides did not participate in the inservice sessions on reading. 
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Figure 1 



Other Suggestions for Future Title I 
Inaervice Training (East Area) 



Clinton 

1. Aide-teacher-administrator roles and responsibilities (T) 

2. Organizing a classroom day (T) 

3. Working with various group sizes (T) 
^. Time to prepare materials (T) 

5. Talking typewriter and Basic Skills Center (T) 

6. Coping with behavior problems (T) 

7. Title I Needs Assessment (T) 

8. Title I Resources (T) 

9« Title I Needs Assessment (T) 

Corcoran 

10. Individualizing reading and math (T) 

11. Individualizing with the ABC materials (T) 
IP. Individi^alizing with the ABC materials (T) 
13. Social studies (T) 

ik. Role of Title I supplemental teacher (T) 

15. DiGcipline (T) 
Science (T) 
Social studies (T) 

16. Use of visual aides 

Greeley ^ 

17. Working with MR and SLBP (A) 

18. Activities for use within skill areas 

Longfello w 

19. Working with aides (T) 

?0. Title I: regulations, program administration, materials available (T) 

21. Management of children-for aides (T) 

22. Reading materials-f or aides (T) 

23. Title I materials (T) 

Time to construct materials (T) 

Games for children (T) 
2^U tluggling funds to get the most for the Title I child (T) 
P^j, Time to construct materials (T) 

Northrop 

26. Materials development (T) 
Seward 

27. Metric system (A) 

28. Reading (A) 

29. Reading (A) 

30. Reading (P)^ 

31. Reading (A) 

32. Assessing and prescribing for children in continous progress (T) 

33. Coping with Title I Behavior Problems (T) 

Standish 

3^^. IMC materials (T) 

Math materials (T) 
1 T=reGponse of participating teacher^ 
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2 A=response of participating aide ^ ^ 

3 P=rosponse of participating parent 2I 



Whittie r 

35. Individualization (T) 

36. Management of children, especially for aides (T) 

37. Time to make a math kit (T) 
Painting (T) 

Creativity in story telling (T) 
3S. Behavior modification (t) 
39. Social studies (T) 
kO. Ckl math (T) 
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^^o^'th Area. Responses to the opinionnaire of the North Area Title I 
inservice were obtained from 82 teachers, ^9 aides, and k parents, a total 
of 135 persons. The rate of response here is approximately 30 percent. 

Data describing the total group response to the opinionnaire are pre- 
sented in Table 3. Results there indicate that mean ratings in the need 
for knowledge factor vary from 2.6 for two topics (Services of Federal 
Projects and Explanation of Title l) to 3-8 for the session on Perceptual 
Motor Development. Mean ratings in the level of satisfaction vary from 
2.7 with the session on Title I Needs Assessment to ^.0 for Perceptual 
Motor Development. Mean ratings in desire for inservice alsp varied from 
a low 1.7 for Explanation of Title I to 3»8 for Perceptual Motor Development. 

Summarizing the data presented here, several trends seem apparent. 

1. Sessions presented^by the Federal Projects Office received somewhat 
lower ratings in need for knowledge prior to the inservice, in 
level of satisfaction with what was learned, and with desire for more 
inservice than other sessions. Between 30 and ^0 percent of the 
participants expressed very little to little need for knowledge in 
that content area prior to the inservice. 

2. The sessions on self-concept and Perceptual Motor Development received 
higher ratings than other sessions. 

3. While mean ratings do not reflect a strong desire for more training . 
in any content area included in this inservice, somQ persons did 
express a high to very high, desire for more information. Areas where 
most persons expressed this desire are assessing without threatening 
(26 persons), learning materials that motivate and encourage v26 
persons), Self-concept, (25 persons). Perceptual Motor Development 
(kO persons), and Developing a Successful Teacher and Aide Team (28 
persons). 

Table ^ presents a comparison of responses to the desire for more inservice 
factor between participants with less than one year cr no experience with 
Title I children and the total group. While differences are anall and somewhat 
inconsistent, persons with experience working with Title I children express 
slightly higher desires for more informations in these content areas than 
their inexperienced counterparts. 
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Table 3 

Sunmary of Participant Responses 
to the North Area Title I Inservice 

July 8 to July 18, 197^* 

Participants: 82 teachers 
'+9 aides 
k parents 

0 other 

Total Participants: 135 



Content Area 


Need for Knowledge 


Level of Satisfaction 


Desire 


for more in-service ' 


Mean 
Rating 


Frequency 


Mesm 
Rat ing 


Frequency 


Mean 
Rating 


Frequency 


1 


2 


3 


k 


5 


1 


2 


3 


k 


5 


1 


2 


3 


k 


5 


Services of Federal 
Projects Office 




25 


26 


28 


20 


8 


2.0 


16 


17 


55 


16 


k 


1.9 


51 


23 


18 


6 


2 


Explanation of .Title I 


2.6 


2*+ 


33 


31 


17 


8 


3.0 


1*+ 


17 


50 


32 


7 


1.7 


60 


23 


13 


. 6 


1 


Urc of Title I materials 

7/8 


2.7 


23 


2*+ 


32 


20 


10 


3.0 


13 


15 


57 


26 


7 


^-.3 


37 


23 


20 


20 


3 


Instructional Materials 
Center (IMC) 


2.8 


23 


16 


31 


22 


11 


3.1 


9 


12 


52 


26 


9 


2.k 


31 


16 


31 


15 




The aides' program 


3.0 


17 


19 


29 


19 


15 


3.2 


10 


9 


kk 


27 


11 


2.k 




17 


21 


12 


q 
y 


Title I objectives and 
evaluation 


2.7 


23 


21 


35 


16 


8 


2.9 


15 


13 


52 


19 


9 


1.9 


kG 


20 


20 


8 


1 


Current Title I Projects 


2.7 


17 


23 


35 


15 


8 


2.8 


16 


1^+ 


52 


19 


k 


2.2 


35 


21 


2k 


12 


1 


Title I needs assessment 


2.7 


20 


20 


37 


18 


7 


2.7 


18 


15 


53 


12 


5 


2.2 


3^ 


20 


25 


11 


3 


Orientation to the Title I 
child 


2.8 


26 


18 


3^ 


18 


1*+ 


2.8 


26 


17 


kl 


26 


9 


2.3 


ko 


21 


23 


12 


7 


AoGORsing without threaten- 
ing: Heading and Math 


3.0 


17 


11 




21 


Ik 


2.9 


11 


21 


58 


18 


8 


2.6 


27 


17 


32 


18 


8 


Learning materials that 
motivate and encourage 


3.2 


11 


6 


35 


2'+ 


11 


3.3 


8 


8 


37 


31 


9 


2.7 


23 


10 


2k 


18 


8 


Self-concept: A process 
approach 


3.3 


6 


2 


35 


17 


8 


3.6 


7 


1 


2k 


18 


19 


3.1 


12 


k 


25 


13 


12 


Perceptued motor 
development 


3.8 


3 


3 


17 


17 


18 


k.o 


2 


1 


15 


17 


2k 


3.8 


3 


k 


11 


22 


18 


Developing a successful 
teacher arid aide team 


" 1 


13 


7 


25 


2k 


17 


3.1 


11 


9 


38 


27 


6 


2.8 


19 


18 


18 


17 


11 



2^+ 



Table k 



Comparison of mean ratings of the desire for more inservice factor between 
North Area participants with less than one year or no experience with Title I 
children and the mean ratings of the total group. 



Content Area 


Desire for more inservice 


Participants with 
less than one year 
or no experience 
with Title I 
children 

N=^l 


Total group 
N=135 


Services of Federal Projects Office 


1.7 


1.9 


Explanation of Title I 


1.7 


1.7 


Use of Title I materials 7/8 


1.8 


2.3 


Instructional Materials Center (IMC) 


*>- 

2.5 




The aides' program 


2.k 


2.k 


Title I objectives and evaluation 


2.1 


1.9 


Current Title I Projects 


2.1 


2.2 


Title I needs assessment 


2.3 


2.2 


Orientation to the Title I child 


2.2 


- 2.3 


Assessing without threatening: 
Reading' and Math 


zA 


2.6 


Learning materials that motivate and 
encourage 


2.7 


2.7 


Self-concept: A process approach 


2.5 


3.1 


Perceptual motor development 


3.5 


3.8 


Developing a successful teacher and 
aide team 


2.8 


2.8 
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Listed in Figure 2 are other suggestions for future Title I inservice 
training in the North Area, While no single need is apparent in the data 
there, most suggestions tend to be related to aide-teacher roles and 
responsibilities perceptual motor develo;'-nent , or motivating students. 
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Figure 2 



Other Suggestions for Future Title I 
Inservice Training (North Area) 



Bethune ^ 

1 . Psychology (A ) 

2. Inservice for aides (A) 

Cleveland ^ 

3- Aide.s roles and responsibilities (T) 

^> Aide-teacher roles and responsibilities (T) 

5. Aide-teacher roles and responsibilities (T) 

H all 

o*. New methods of presenting material to students (A) 

7- Aide -teacher roles and responsibilities (T) 

8. Testing vision (T) 

9- Title I Needs Assessment Form (T) 

Hawthorne 

10. Coping with behavior problems (A) 
Aide-teacher roles and responsibilities (A) 

Holland 

11. Perceptual motor development (T) 

12. Materials that motivate (T) 
Adlerian psychology (T) 

Lincoln 

13. Nf'W davelopmori from the f^iovornmont (T) 
Reading (T) 

i^. Effective uiseG of tapes (T) 

Webster 

16. Use of audiovisual material (A) 

17. Self-confidence (T) 
Self -discipline (T) 

18. Adlerian psychology (T) 

19. Perceptual motor development (T) 
Individualization (T) 

Diagnosing reading and math needs (T) 

20. Reading materials 

21. Instructional materials for the specialist; P.E. , Art, and Music (T) 

School Unassigned 

22. Use of A-y equipment (A) 



A:=response of a participating aide 
^T=response of a participating teacher 
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West Area. Responses to the opinionnaire of the West Area Title I 
inservice were obtained from 80 teachers, aides, 3 parents, and 9 
administrators or supervisors, a total of 139 persons. This rate of 
response is consistent with the average daily attendance at the East Area 
inservice sessions. 

Data describing total group responses to the opinionnaire are presented 
in Table 5« Results there indicate that mean ratings in the need for know- 
ledge factor vary from 2.3 fo^^ the session on the Explanation of Title I to 
3.^ for Affective Behavioral Objectives. Response to the level of satisfaction 
vary from 2.3 for Title I Needs Assessment to 3«7 for the Concept of Self- 
Concept, In the desire for more inservice factor responses vary from 1.8 
for Services of the Federal Projects Office and Explanation of Title I to 
3«^ for the sessions on Survival Techniques of Students and Affective 
Behavorial Obj'=^ctives. 

Summarizing the data here, several patterns seem to emerge: 

1. Although the variance between low and high mean ratings is fairly 
small, it is apparent that sessions presented by the Federal Projects 
Office received consistently lower ratings in need for knowledge 
prior to the inservice, in level of satisfaction with what was 
learned, and in desire for more inservice than other sessions. From 
k3 to 50 per cent' of the participants expressed very little to little 
need for information in that content area prior to the inservice. 

2. Sessions entitled, The BHack Family, Survival Techniques of Studonts, 
The Concept of Self-Concept, Behavioral Objectives, The Life Space 
Interview, and Affective Behavioral Objectives were rated equally 
and somewhat higher than the others. 

3. The mean ratings reported here reflect from average to low desire for 
additional training in these content areas. However, some persons 
did express high to very high desires for more information in each 
content area. Areas where most persons expressed such desire include: 
Survival Techniques of Students (32 persons). The Concept of Self 
Concept (3^ persons). Behavior Objectives (50 persons). The Life 
Space Interview (50 persons), and Affective Behavioral Objectives 

(60 persons). 

Table 6 presents a comparison of responses to the desire for more inservice 
factor between participants with less than one year or no experience with 
Title I children and the total group. What is significant about the data 
presented here is the difference content presented by the Federal Projects 
Office. Persons with little or no experience in Title I expressed somewhat 
hdz-^iher desire, for more inservice in those content areas t?ian the total group 
of participant s« There was little difference between responses to the re- 
maining content areas. 

Listed in Figure 3 sire other sugge.stions for Title I Inservice training . 

3 5 
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Table 5 

Summary of Participant Responses 
to the West Area Title I Inservice 

July 8 to July 18, 197^ 

Participants: 8o teachers 
k7 aides 
3 parents 

9 other 

Total Participants: 139 



Content Area 


Need for Knowledge 


Level of Satisfaction 


Desire for more in-service 


Mean 
Rating 


Fre< 


:^uency 


• Mean 


Frequency 


• Mean 


Frequency 


1 


? 


3 




5 


Ra t ing 


1 




3 


4 




1 ici u J 1 IK 




p 




4 


5 


ot*rvice6 of Federol 
Projects Office 


2.^4 




20 


32 


19 


6 


2*5 


33 


25 


42 


22 




1.8 


64 


19 


21 


7 


3 


Explanation of Title I 


2.3 






7? 




D 


2.7 












1-8 


Do 


10 


do 


3 


2 


Use of Title I materials 


2.5 


38 


23 


31 


23 


5 


2.5 


35 


22 


41 


25 


2 


2.2 


51 


18 


25 


15 


5 


Instructional Materials 
Center (IMC) 


2.'+ 


39 


25 


29 


19 


7 


2.7 


2'+ 


21 


49 


27 


5 


2.0 


56 


17 


30 


10 


2 


The aides' program 




36 


27 


32 


17 


9 


2.5 


35 


21 


46 


21 


4 


?:.o 


55 


24 


26 


7 


4 


Title I objectives and 
evaluation 




38 


25 


31 


20 


7 


2.6 


26 


28 


44 


24 


3 


2.0 


54 


20 


29 


8 


4 


Current Title I Projects 




37 


22 


i+O 


12 


9 




33 


22 


51 


18 


1 




59 


20 


26 


6 


5 


Title I needs assessment 




39 


22 


30 


15 


9 


2.3 


3^ 


29 


40 


15 


1 


2.1 


50 


18 


27 


7 


6 


The black family, a com- 
paT'ativQ analysis 


3.2 


l'* 


12 




30 


17 


3.6 


7 


9 
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28 


3.1 


18 


16 


40 


22 


19 


Value elicitation 
experience 


3-0 


12 


11 


55 


22 


8 




9 


5 


55 


25 


20 


2.8 


22 


12 


41 


16 


12 


Survival techniques of 
students 


3.3 


6 


15 


52 


27 


16 


3.6 


it 


5 


50 


37 


28 


3.4 


10 


11 


40 


31 


21 


Socio-metric techniques 
Tor fichoolfi 


3.0 


10 


17 




18 


9 


3.2 


9 


12 


47 


20 


16 


3.0 


13 


17 


33 


23 


9 


Community-Parent Teacher- 
Dialogue 


2.9 


21 


l^t 




24 


13 


2.6 


37 


23 


29 


21 


13 


3.0 


26 


11 


32 


21 


23 


The concept of self-concept 


3.2 


8 


1^ 


5^ 


28 


1^ 


3.7 


3 


6; 


46 


'41 


30 


3.3 


16 


9 


37 


31 


23 


Behavioral objectives 


3.2 


8 


\U 


5^ 


26 


15 


3.5 


3 


10 


57 


29 


23 


3.3 


12 


9 


42 


31 


19 


The life space interview 


3.3 


9 


7 


63 


23 


19 


3.6 


5 


9 


52 


33 


28 


3.2 


16 


11 


41 


28 


22 


Affective behavioral 
objectives 


3-^ 


6 


13 


^9 


33 


18 


3.5 


5 


8 


5^ 


36 


23 


3..4 


13 


9 


34 


36 


24 
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Table 6 



Comparison of mean ratings of the desire for more inservice factor between 
West Area participants with less than one year or no experience with Title I 
children and the mean ratings of the total group. 



Content Area 


Desire for More Inservice 


Participants with 
less than one year 
or no experience 
with Title I 
children 

N=28 


Total group 
N=139 


7/8 


2.2 


1.8 




1.9 


1.8 




2-7 


2.2 


7/8 


2A 


2.0 




2.5 


2.0 


'P'i4*''^ T <^"h "1 ^r»4* n vo c! anrl ^^ral n a4* n /^n 

7/11 


2.5 




Current Title I Projects 


2.3 


1.9 


Title I needs assessment 7/11 


2.6 


2.1 


The black family, a comparative 

ctllclX J oX o 


3.0 


3.1 


V axue ei.xcxcabxon experience 


2.8 


2.8 


5^1 1 v'Tf n Trial 4*o/^Vinn r^iioc* c!4*n/^Qn4*c! 
OU.X V X V dX. b GL/XillXQUt? o OX obUQcIlbo 


3.'f 




Sopi o— mpt T*"! p 4" ppVin 1 mi p j=i "Fot* RfVinnl r 

^-^ w J- v> HI L> X U ^V^XUL.l«i-\J Lie O X WX OV^llWWJ^O 


3.0 


3.0 


Community-Parent Teacher-Dialogue 


■ 2.5 


3.0 


The concept of self-concept 


3.0 


3.3 


Behavioral objectives 


2.9 


3.3 


The life space interview 




3.2 


Affective behavioral objectives 


3.3 


3.k 



37 

30 



Figure 3 



Other Suggestions for Future Title I 
Inservice Training (West Area) 

Bryn Mawr 

1. Use of Title I materials (T) 

. Aide roles and responsibilities (T) 

2. Developing materials (T) 

Coping with behavior problems (T) 

3. Native American and Chicano ethnic backgrounds (T) 
k. Self-concept (T) 

Conflict resolution (T ) 

5. Title I materials (T) 

Calhoun 2 

6. Teacher-aide roles and relationships (A) 

7. Teacher-aide roles and relationships (A) 

8. Spanish surnaine and Native American cultures (A) 

Harrison 

9. Coping with behavior problems (A) 

10. Title I- materials (A) 

11. Title I Needs Assessment (T) 

12. IMC and Title I materials (T) 

13. Title I Needs Assessment (T) 

1^. Focusing on verbal and writing skills for black children without discrediting 
their own language (T) 

Kenwood 

15- Indian culture (Other) 

16. Helping children of different races get along. 
Lyndale 

17. Teacher-teacher relations (T) 

Functions of social worker vs. school counselor. (T) 

18. Title I materials 

19- Coping with behavior problems (A) 

20. Coping with behavior problems (A) 

21. Black-white life styles-attitudes (A) 
Attitudes toward school administrators. (A) 
Black fsimily analysis (A) 

West Area Intermediate Center 

22. Title I Needs Assessment (T) 

23. Self-concept (T) 
Outdoor education (T) 

2k. Student interaction (Minority/^agori^y.) (A) 
Building a multi ethnic curriculum (A) 
Building trust (Majority/Minority) (A ) 

25. Title I materials 

Coping with behavior problems 

Not assigned to one school 

26. Coping with conflict Tt) 

27. Title I Needs Assessment (T) 
Diagnosing special learning problems (T) 

28. Coping with behavior problems (T) 

1 T=response cf participating teacher 

2 A=response of participating aide q q 

00 
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29. Coping with behavior problems (T) 

30. Coping with behavior problems (T) 
Pcirent-teacher communications 
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in the West Area. Suggestions tend to focus on understanding ethnic 
backgrounds and interactions and coping with behavior problems. 
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Summary of Qpinionnaire Results , Overall, results of the opinionnaire 
were fairly consistent among the three areas. Mean ratings of the need for 
knowledge factor ranged between low-average (2.3 on a 5 point scale) and high- 
average (3.8) means for the level of satisfaction factor ranged from low- 
average C'2.3) to high (^.0)/and means of the desire for more information 
factor ranged from very low-low (I.7) to high-average (3.8). Sessions pre- 
sented by the Federal Projects Office received consistently lower ratings than 
other sessions. In each instance there seemed to be a high per cent of 
participants who felt very little or little need for inservice in that content 
area. In both the East and Vest Areas persons with little or no experience 
with Title I children rated the Title I sessions higher than the total group. 
Although the mean ratings for the need for more inservice factor did not 
reflect a strong need for more training in any one content area, some persons 
did express a high to very high need for more inservice. For items marked by 
the rating scale, expression of need for additional inservice seemed to be 
highly correlated with the level of satisfaction with a session. Similarly, 
suggestions for future inservice training presented in the open ended items 
generally reflected the theme of the inservice for that Area. 

Recommendations 

From the information presented here a number of recommendations seem 
appropriate for consideration when planning future Title I inservice. 

1. The general dissatisfaction with the Federal Projects presentations 
evidenced here seems to indicate that: 

a. Some alternative should be provided when the content to be ixicluded 
is likely to be repetitious for many participants, and that 

b. Classroom teachers should be involved in committees to plan inservice 
sessions. 

2. Because of the strain tardiness imposes on meeting schedules and the 
disruption caused by numerous late arrivals, some attempt should be 
made to begin inservice sessions on time. 

While no one solution Is obvious, some possible alternatives are: 

a. Using a microphone to announce the beginning of sessions. 

b. Penalties in reimbursement for unreasonably late arrivals. 

c. Holding meetings in more confined areas 
dm Fewer coffee breaks 

e. Scheduling ample time for participants to have lunch during all- 
day sessions. 

3. In cases where participants are given choice of sessions, uncomfortable 
overcrowding of space might be avoided if a preliminary count of in- 
tention were made and locations (from a number of alternatives) assigned 
on that, basis. 
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Since operational guidelines for the North, the West, and the East 
Area Staff Development components involved simply transferring details 
from the program plan to the format of operational guidelines, and 
since no qualitative or quantitative criteria were established for 
observing implementation, it seems reasonable to recommend that this 
task be eliminated. However, the development of guidelines for the 
management or coordination should be maintained. 

Timely reporting of results is an essential criterion of effective 
evaluation. Because the process of communicating results via formal 
project reports is a laborious and time consuming task, and because 
few persons probably take the time to wade through such reports, some 
attention should be given to streamlining this report process. 
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MATHEMATICS CRITERION REFERENCED TESTING PROGRAM 
Focus of the Evaluation 

Consistent with the original Title I, Part C, grant application, the 
primary focus of this evaluation is on the process of implementing the 
Mathematics Criterion Referenced Testing Program, not on the outcomes of that 
program. 

By way of background information, the purpose of the process evaluations 
implemented for Part C projects was to determine whether or not projects were 
implemented according to the proposal and to identify specific problems and 
successes with their implementation. That process involved four steps: 

1. Establishing operational guidelines for the project. Operational 
guidelines are specific project plans which identify the major components 

. • of a project, specific activities which must be completed within each 
component, persons responsible for those activities and anticipated 
completion dates or frequencies. They are developed cooperatively by 
the project coordinator and the evaluator. However, each person with 
responsibility for the project is given an opportunity for input. The 
guidelines are completed only when persons responsible reach consensus on 
their content c & 

2. Using operational guidelines, to observe each project to identify 
successes, problems, and discrepancies between those guidelines and the 
actual implementation of the program. 

3. Asking each person participating in the project to maintain a log of 
successes, problems, and discrepancies between guidelines and actual 
implementation. 

^. Preparing a siimmary report of process observations. 

In this case, the evaluation was limited primarily to step 1, establishing 
detailed operational guidelines. There were three reasons for this. First, 
this project presented the unusual problem that three of its four goals were* to 
be implemented after the August 51, 197^, termination of project and evaluation 
funds. A second factor which limited the extent of the evaluation was its brief 
duration. Developing operational guidelines was a slow, laborious project which 
was not finalized before that two month period ended. Finally, the Director of 
Federal Projects expressed a strong interest in the development of operational 
guidelines for this program. 

To summarize, the evaluation presented here is only the first step in 
a total assessment of the Mathematics Criterion Referenced Testing Program. 
Focusing on the development of operational guidelines, it will present, first, 
a description of the project* A copy of the guidelines in use as of August 31» 
197^1 and a summary of issues yet unresolved among persons responsible for the 
project. In addition, some attempt will be made to compare implementation 

43 

ERIC 



to the project proposal for those activities completed prior to September 

Project Description 

According to the Title I Part C application for grant, the purpose of the 
Criterion Referenced Testing Program was to produce a computational math skills 
testing program for Title I children in grades K-6, Major characteristics of 
the instrument to be developed were (a) that it be keyed to instructional 
objectives for each strand and grade level of mathematics and (b) that it 
include alternative forms of test items. 

However, once project funds had been granted and plans for implementation 
were underway, three additional gosils were identified. They were: 

1, To identify Title I children in mathematics 

2m To provide evaluation of progress of identified Title I children, 
3, To eva3_uate math programs used in the 197^-75 achool year. 

Specific activities related to each of these goals and persons responsible for 

them are outlined in the operational guidelines that follow, 

. 1 , 
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Title I, Part C 
Mathematics Criterion Reference Testing Program 

OPERATIOML GUIDELIMES 



Component; Project Management Page 1 



Ope.?ation 

Number 


Activity 


Ail wXCX {Ml wOQ 

Couplet ion 
Date or 


ilC vUBtl 

Completion 

Date or 
FresueDcy 


Person 
Kes pons! Die 




RESOURCE AT. T. on AT TOM 










i ersonnei. 










Selection 










Select project leader 




5/13/7'f 


Ross Taylor 




Select resource teacher 




5/13/7'f 


Ross Taylor 




Select 15 resource teachers 




S/7/7k 


Dennis Lander 




Select ^9 classroom teachers 




6/7/7h 


Dennis Lander 




Select secretary 




6/17/7'f 


Dennis Lander 




Payment 










Submit service reports for payment of 
teachers on special assignment. 


Every two 
week's 


Every two 
weeks 


Dennis Lander 




Submit ^neral requisition . forms for 
payment of resource and classroom 
teachers. 


7/26/7^ 


By 7/26/7'f 


Dennis Lander 




Budget 










Maintain project budget 


As needed 


As needed 


Paul Larson 




PROJECT PLANNING 

Identify project decision maker needs and 
expectations 






Principals' 
'*cLvxsory group 
on Part C 




Clarify workshop goals 


6/18/7'f 


6/18/7'f 


Barbara Bellair 




Develop outline of project activities 
anticipated completion dates, and persons 
responsible for each. 


6/18/7'f 


6/18/7'f 


Dennis Lander 




Secure consensus on operational guidelines 
with project decision makers and partici- 
pants. 


7/3/7h 


Not 

completed 






PROJECT IMPLEMENTATION 


z. 








Supe rvi s ion 










Contact each program participant to make 
sure that he (a) understands his responsi- 
bilities and (b) is able to fulfill them. 


^s needed 


As needed 


Dennis Lander 




Observe daily progress of project to 
identify problems and discrepancies betweer 
the project plan and actual implementation. 
Use this information to modify project 
implementation or plans. 


Daily 


Daily 


Dennis Lander 
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OPERATIOHAL GUIDELZIIES 



Development of 
Component : Testing Instruments 



Pc^e 



Operation 

Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



Identify Math Objectives for Grades 1 to 6 

Form a pool of math objectives for grades 
1 to 6 from: the Michigan Minimal Math 
Objectives, state and national assesanents 
SRA Systems Math Program, Houghton Mifflin 
Individual Math Program, and others. 

Teachers representing a city-wide scope 
will identify desired behavioral objective; 
for all children participating in the 
1 to 6 math program 

Eight teachers at each grade level will 
rate each objective identified on a five 
point sc6.1e as to whether it should be 
included in the assessment package. 

Tabulate ratings 

Review ratings; determine which objective; 
should be included within each content 
strand and each grade level 

Write Test Items ^ 

Small groups of teachers will write k test 
items for each objective 

As the objectives are written each group 
will share its items with other groups to 
gather opinions about whether the test 
items actually measure the objectives as 
intended 

Assemble Testing: Package 

A small team will package the objectives 
and test items: 

a. Set page formats 

b. Identify manipulative materials 
c* Collect manipulative materials 
d. Supervise typing and production 
e* Assemble packages 

A jsmall team will develop a plan (who is 
tested, how, what additional testing may 
be needed) for testing children in mid 
September, 197^, 
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6/28/7^ 



7/18/7^ 



7/23/7^ 
7/2S/7k 



7/5/7^ 
7/5/7^ 



9/1/7^ 



7/15/7^ 



6/21/7^ 



6/28/7^ 



7/18/7^+ 



7/23/7^ 
7/26/7^ 



7/5/7^+ 
7/5/7^+ 



NA 



6/26/7^ 



Dennis Lander 



Dennis Lander 



Dennis Lander 



Dennis Lander 
Dennis Lander 



Dennis Lander 
Dennis Lander 



Dennis Lander 



Dennis Lander 



OPERATIOML GUIDELUCBS 



Component: 



Identification of 
Title I Children 



Page 3 



Operation 

Number 



Activity 



Anticipated 
Completion 

Sate or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Kesponaible 



*Test all children in each Title I build- 
ing to determine achievement of math 
objectives. 

*Recommend that children who score one 
grade level or more below their assigned 
level receive Title I assistance. 



10/15/7^ 



10/15/7^ 



NA 



Barb Bellaire 



Barb Bellaire 



ERLC 



^Activity unresolved among all persons bearing responsibility for the project. 



OPERATIOmL GUIDELUBS 

Evaluation of 197^-75 
Component: Title I Math Achievem ent Page 



Operation 

Number 



Activity 



Anticipated 
Completion 

Date or 
Frequency 



Actual 
Completion 

Date or 
Frequency 



Person 
Responsible 



In spring 1975 test Title I children with 
a parallel form of the math test admin- 
istered in September, 197^« 

Determine the amount of growth for each 
child during the 197^-75 school year. 



Spring 
1975 

9/1/75 



NA 



Barb Bellaire 



Barb Bellaire 



ERLC 
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OPEatATIOML GUIDELIIIES 



Evaluation of 
Component; Alternative Math Progr am Page _5 



Operation 

Number 


Activity 


Anticipated 
Conpletion 

Date or 
Frequency 


Acttial 
Conpletion 

Date or 
Frequency 


Person 
fiesponsible 


/ 


Compare test scores between each commer- 
cial math program being used in Minneapolii 
Public Schools ajad the currently adopted 
Houghton Mifflin Modem Math and Structure 
and Use program. 

*Compare test scores among commercial 
math programs used in Title I schools 
in Minneapolis. 

■ 1 






Barb Bellaire 
Barb Bellaire 
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Summary of Findings 

Development of operational guidelines . Probably the single greatest value 
of operational guidelines is that their development requires consensus with 
the content from each person involved. That is, each person with responsibility 
for the project must agree that the guidelines are an adequate reflection of 
both the design and the intent of the project. 

From the outset of the Mathematics Criterion Referenced Testing Program, 
it was evident that this project was a complex one with a number of potential 
implications for future Title I placement and programming. Because this project 
was so intertwined with and in a sense limited by the Title I program in operation 
the development of operational guidelines was a difficult and intensive task. 
Guidelines were first drafted by the evaluator from the project proposal and 
goal statements. Then they were reworked item by item in meetings with the 
project leader, Dennis Lander. Copies of the version that emerged were shared 
with the math consultants by the project leader and with the Federal Projects 
Office by the evaluator. Following is a brief summary of reactions to the 
guidelines that were submitted. 

Generally speaking, consensus was reached on goals one and three. Decision 
makers from the. Federal Projects Office and the Mathematics consultants came 
quickly to BTi agreement on both the type of pre testing instruments to be 
developed and the process for developing it. Likewise, there was no apparent 
disagreement with that instrument being used pre and post to measure growth in 
computational math skills for each Title I child during the 197^-75 school year. 

For both goal two and goal four issues were identified which prevented 
total acceptance of the guidelines by one or more of the persons responsible 
for the project. Goal two was '^to identify Title I children in mathematics." 
The problem identified here was primarily an operational one. According to 
Title I regulations, children are designated as Title T^hy total educational 
disadvantage, not by individual content areas. In other words, the concept 
identifying ^"Title I math students" was in conflict with the definition of 
Title I. Still it was noted that the instrument developed could provide help- 
ful input into the total identification process. Several alternatives were 
cited: 

a. Scores from the criterion referenced instrument could replace the 
standardized math scores currently used, 

b. Results of the intstrument could be used as input for classroom teachers 
in making judgments about the rating of each child, or 

c. The instrument could be used to diagnose children once thpy have been 
identified as Title I according to the current operational procedures. 
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Goal to evaluate math programs used in the 197^-75 school year was 
expressed as a concern by the project leader. The concern was for individual 
teachers who would be personally identified with a number of alternative math 
programs being used. There was some indication from both Federal Projects 
and the project leader that a meeting to discuss these matters would be 
helpful. However, such a meeting had not been scheduled when the funding 
period ended. 

Implementation of Operational Guidelines . As explained in previous 
sections, activities related to goal one were the only ones scheduled for 
completion before project funding terminated. Stratifying math objectives, 
writing test items, and assembling testing packages all seemed to be implement 
and completed according to the project plan. 
Recommendations 

Based on observations made during the first phase of the Criterion 

Referenced Mathematics Testing Program, the following recommendation seems 

particularly important: 

The federal Projects Office and the Mathematics consultants should seek 
to resolve issues related to goals 2 and k in the operational guidelines. 

It seems advisable, too, to suggest that: 

The development of operational guidelines in future Title I projects ' 
might be facilitated by a joint meeting of project decision makers so 
that persons with responsibility for the project could respond to a 
•proposed draft and work through potential conflict. 
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Oplnlonnaire 
Title I Part C East Area In-Service 



DIRECTIONS: Please check ( ) the appropriate line to provide the following information: 



CLassification of your participation in this in-service: 
ichool name (197^-75) . 



(l)teacher; (2) aide; (3)parent; (U)other 



Type of organization you worked with last year: (i)tt'aditional; (Sjcontinuous progreon; (-jjopcn; (^)other 

Type of organization you will be working with next year: ( l)traditional; (2)continuou8 progress; (3)open; 

(U) other 

Previous e)cperience with Title I children: (1)3 yrs or more; (2)1 to 3 yrs; (3)lefl« than 1 yr; (i|)none 



♦ ♦ ♦ DIRECTIONS ♦ ♦ ♦ 

Listed below are each of the content areas covered in this East Area Title I in-service, 



1 



1 2 3 ^ 5 

very 1cm low average ; high very high 



Using this scale: 
please rate each component of the in-service on: 



Your need for knowledge in the content area prior to the in-service 
. Your level of satisfaction with what you learned 
Your desire for more in-service in this area 

If you did not attend a session listed, leave the spaces blank. 





Need for 


lievel 


Desire 






Need for 


Level 


Desire 




knowledge 


of 


for 






knowledge 


of 


for 




prior to 


satis- 


more 






prior to 


satis- 


more 


Content Area 


in-serv. 


faction 


in-serv. 




Content Area 


in-serv. 


faction 


in-serv 



FEDERAL PROJECTS 

Services of Federal Projects 
Office 7/8 

Explanation of Title I 7/8 

Current Titl^ I .projects 7/B 

Use of Title I materials 7/8 

Instructional Materials 
Center (IMC) 7/8 

The aides' program 7/8 

Title I objectives and 
evaluation 7/11 

Title I needs assessment 7/11 

READING 

Dr. M. Vere DeVault's pre- 
sentation on Strategies and 
Systems for Individualizing 
Reading Instruction 7/9 

Language experience techni- 
ques for primary children 7/12 

Language experience techni- 
ques for intermediate children 
7/12 

^ Moffett interaction program 
for primary children 7/12 

Moffett interaction for inter - 
mediate children 7/12 

Interest surveys and diag- 
nostic tools for primary 
students 7/ is 

Interest surveys and diag- 
nostic tools for inter- 
mediate = VwiUents 7/15 



MATHEMATICS 

Individualizing Instruction 



Dr. M. Vere DeVault's 
presentation on Strategies 
for Individualizing Math 
Instruction 7/10 

COAM and CAI as tools 
for individualizing 7/10 



gm^^'cial reading. materialfl7/ 16^ 

LimmimmmiM >p comprehension tech- 
niques 7/l6 



Using diagnosis kits to 
assist In individualiz- 
ing the Houghton Mifflin 
Math program. 7/10 

An example of how an 
individualized math 
program functions 7/10 



An example of an assess- 
ment tool to use in the 
individualizing process7/10 



H(M to write behavioral 
objectives 7/17 

. Critiquing objectives 
from various sources 7/17 

Math Materials 

GtJ^^a (Say and Play)7/l8 

Activity cards (See and 
Do) 7/l8 

Films and tapes (See and 
Hear) 7/l8 

Drill materials (Write 
and Practice) 7/l8 



k6 



Researu;; and Evaluation Department 
July 197** 



Are there other topics which you feel should be included in Putm« Title I 
in-service training? If so, please list them here in priority order. 



Other conmejats aibout the in«*service7 



For aides and teachers only: 



Do you have any concerns about the aide-teacher team in your school setting 
next year? If so, please describe them here> 



As an aide or a teacher who vill be working with an aide, do you feel that 
further in-service training will be necessary? ^Please explain. 
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